Stochastic memory: memory enhancement due to noise 
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There are certain classes of resistors, capacitors and inductors that, when subject to a periodic 
input of appropriate frequency, develop hysteresis loops in their characteristic response. Here, we 
show that the hysteresis of such memory elements can also be induced by white noise of appropriate 
intensity even at very low frequencies of the external driving field. We illustrate this phenomenon 
using a physical model of memory resistor realized by TiC>2 thin films sandwiched between metallic 
electrodes, and discuss under which conditions this effect can be observed experimentally. We also 
discuss its implications on existing memory systems described in the literature and the role of colored 
noise. 



I. INTRODUCTION 

Memory effects are very common in nature and de- 
velop whenever the dynamical properties of a system de- 
pend strongly on its history pQ. In certain structures 
of condensed matter physics these memory features ap- 
pear most strikingly in the hysteresis behavior of their 
resistive, capacitive, and inductive characteristics when 
subject to time-dependent perturbations. In particular, 
this hysteresis is more pronounced for periodic pertur- 
bations of appropriate frequencies corresponding to the 
inverse response time of some state variables of the sys- 
tem pQ . These memory elements are usually called mem- 
ristors [2,, memcapacitors and meminductors [3], respec- 
tively. Their advantage is that they may retain informa- 
tion without the need of a power source, and they have 
found application in diverse areas of science and technol- 
ogy ranging from information processing to biologically- 
inspired systems [4HI2]. So far, however, all these studies 
have neglected the important effect of noise on the mem- 
ory properties of these elements. 

Noise comes in various forms and it can be generally 
classified as internal or external to the system [13] . While 
internal noise can provide much information on the sys- 
tem dynamics, external noise is generally considered a 
nuisance for practical applications. We then naively ex- 
pect it to be a detrimental effect on the hysteresis of 
memory elements. 

In this paper we show instead that under specific con- 
ditions on the strength of the noise the latter may in- 
duce a well defined hysteresis even at low frequencies of 
the driving field. This phenomenon is reminiscent of the 
stochastic resonance effect that has found widespread use 
in research |14H16j . The optimization phenomenon of 
hysteretic structures due to the stochastic resonance has 
already been reported earlier with regard to bistable and 
multistable potentials [T7J [TH] , and neural networks [T5] 
and has also been formally studied in [20 . In this paper 
we will make a connection between the "stochastic mem- 
ory" effect we describe here and the theory of stochastic 
resonance. In order to illustrate the effect we predict, we 
refer to a widely used model of Ti02 memory resistor in 
which the motion of oxygen vacancies in the TiC>2 thin 
film induced by an external electric field is thought to be 



responsible for memory [21] . In this case, the noise could 
be tuned via, e.g., a temperature variation, thus allowing 
an easy test of our theoretical predictions. In general, we 
anticipate that the phenomenon we discuss may emerge 
in many experimentally realized memory systems, there- 
fore providing valuable information on the physical pro- 
cesses responsible for memory. 



II. STOCHASTIC MEMORY ELEMENTS 

Let us then start by defining a general system with 
memory. If u(t) and y{t) are any two complementary 
constitutive circuit variables (current, charge, voltage, or 
flux) denoting input and output of a system, respectively, 
and x is an n-dimensional vector of internal state vari- 
ables, a generic memory element is defined by the set of 
equations [3] 

y(t) = g(x,u,t)u(t) (1) 
x = f(x,u,t). (2) 

Her, j is a generalized response, / is a continuous n- 
dimensional vector function, and the dot denotes a time 
derivative. In particular, the relation between current 
and voltage defines a memristive system [2,, the rela- 
tion between charge and voltage specifies a memcapac- 
itive system [3], and the flux-current relation gives rise 
to a meminductive system [3]. The distinctive feature of 
memory elements is the existence of a hysteresis loop that 
emerges when the response y(t) is plotted vs the input 
u(t) for at least one cycle (see Fig. [2]). The shape of the 
hysteresis and its characteristics are determined by the 
system itself, initial conditions and the applied input, in 
particular its shape, frequency and amplitude pQ. How- 
ever, quite generally, the hysteresis loop is negligible at 
very small frequencies (the state variables are able to fol- 
low the external perturbation), and at high frequencies 
(the state variables do not have time to adjust to the 
instantaneous value of the external perturbation). At 
intermediate frequencies, dictated by the internal physi- 
cal processes responsible for memory, a finite hysteresis 
amplitude develops. 

If the state variables are now subject to noise we can 
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extend the above definition as follows pQ [3D] 

{V(t)h = {$(*,«, *)}*«(*) (3) 
i = f(x,u,t) + H(x,u,t)£(t) (4) 

where is an n-dimensional vector of noise terms de- 
fined by 



(5) 



The symbol (•) indicates ensemble average and fcy(t, t') 
is the autocorrelation matrix. The symbol then has 
the meaning of a realization of the stochastic process £ (£) . 
For white noise on each independent state variable we can 
choose kij(t,t') = TiSijS(t — t') with the strength of 
the noise. For colored noise, one would have different au- 
tocorrelation functions (see below). The term H(x,u,t) 
is some n x n matrix function allowing for possible cou- 
pling of the noise components. Clearly, the system is 
deterministic if H(x,u,t) = 0. Equations ^ and Q 
suggest that at a given frequency of the external input 
u(t), noise would simply destroy the hysteresis by intro- 
ducing random fluctuations in the state variables, and 
hence in the response function g. We give below reasons 
why this is not always the case. Instead, under specific 
conditions, white noise and even more so colored noise 
assist in the development of the hysteresis loop. We first 
provide simple analytical arguments followed by a phys- 
ical example we have solved numerically. 



III. RESULTS AND DISCUSSION 

To develop an analytical understanding of this phe- 
nomenon let us consider only memory elements without 
an explicit dependence of the response function g and the 
function / on time. For simplicity, we assume only one 
state variable x and a constant coupling of H{x 1 u, t) = 1 
to white Gaussian noise £(i) of strength T. From Eq. |3]) 
we then obtain the equation for the time derivative of the 
response function 



dg , . dg . dg . . 
9 = Tx f{x ' u) + du U+ dx m 
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which has to be interpreted as a stochastic differential 
equation. The last term in Eq. ^ comes from ltd cal- 
culus [22]. Let us consider a sinusoidal field u(t) = 
i*o sin(ojo^) of frequency ujq and amplitude no. We also 
assume that the internal state variable x is confined be- 
tween two boundaries X\ < x < X2 (consequently, the re- 
sponse g varies between two extreme values set by these 
limiting states of the system), and there is a time scale 
t associated with the change of the internal state from 
x\ to X2- Therefore, we expect that at low frequencies, 
ujq <C 27r/io and for small amplitudes uq, the state vari- 
able follows the slow change of the input u(t), so that |^ 
can be approximated, to first order, as a constant (call it 
a). Then Eq. ^ reads 

g = af(x, u) + — u u> cosu> t + a£(t) (7) 
ou 
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FIG. 1: Schematic of a TiCh memristor of length L made of 
a doped and an undoped region, and its simplified equivalent 
circuit. The doped region of length w has resistance y-Ron 



and the undoped region has resistance (l 



Rati- 



This equation, along with the above assumptions, re- 
minds us of the phenomenon of stochastic resonance of a 
classical particle in a double- well potential Vq(z) in the 
large damping limit (see, e.g., Ref. [TB] and references 
therein). In this case, the equation of motion for the 
position z of the particle is 



coswt + Ht) 

dz c 



(8) 



where Vq(z) describes the symmetric double- well poten- 
tial with 2c the distance between the wells minima (equi- 
librium states of the particle), V\ - cos tut is a small mod- 
ulation of the potential, and £(t) is white noise. The term 
V\ < AV is the amplitude of the periodic modulation of 
the potential which is smaller than the potential barrier 
AV^ between the two wells. Hence the periodic driving 
alone cannot induce transitions from one well to another. 
In contrast, there exists an optimal noise strength such 
that the stochastically activated transitions between the 
wells are most likely to occur after one half of a cycle of 
the periodic modulation. Consequently, the response is 
optimally synchronized with the external driving at some 
finite noise strength and almost-periodic transitions are 
observed |16j . By comparing Eq. ^ with Eq. ^ we can 
then associate the function f(x,u) in Eq. (JtJ) with the 



force 



dVo(z) 
dz 



applied to the particle, and the small mod- 



ulation of the potential with the term proportional to 
the periodic field that attempts to drive the system from 
state X\ to state xi and vice versa. However, without the 
addition of some noise the driving field is unable, within 
a period, to induce transitions between the response ex- 
trema. This analogy [31j allows us to anticipate that, like 
in the case of the stochastic resonance, the hysteresis in 
the response g may be produced as a cooperative effect 
between the noise and the driving at appropriate noise 
strengths and under the conditions specified above. 

In order to illustrate the above phenomenon in an ex- 
perimentally realizable system, we consider the model of 
a memristor presented in Ref. [21] (Fig. [IJ . It consists of 
a thin film (on the order of a few nanometers) containing 
one layer of insulating TiC>2 and one layer of oxygen-poor 
Ti02- X between two metal contacts. Oxygen vacancies 
in the system act as mobile +2 charged dopants. These 
dopants create a doped TiC>2 region whose resistance is 
much lower than the resistance of the undoped region. 



The location of the boundary between the doped and 
undoped regions, and therefore the effective resistance of 
the film, depends on the position of the dopants and can 
be modified by applying an external electric field. The 
mobility of the dopants is fi D ~ f CP 10 cm 2 V _1 s -1 . We 
take as total size of the memristor L = 10 nm and de- 
note the length of the doped region as w. The current 
is I(t) = V(t)/M(w) with the effective resistance of the 
system approximated as |21j 

M(w) = ~R on + (l - ~J R olf (9) 

where i? on is the resistance of the memristor if it is com- 
pletely doped, and R o{t is its resistance if it is undoped. In 
the following we set R oa = 1 kil and R o!i = 4kf2. The sys- 
tem is controlled by the applied voltage V(t) = Vq sin uj t. 
The memristive effect in this model arises from the time 
dependence of the width of the doped region w [23] [3"2"] 



dw 



L 



I(t)F 



L£(t) 
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where the width is limited by < w < L and F(x) = 1 — 
(2.t — l) 2 suppresses the speed of the boundary between 
the two regions at the edges w ~ and L [53]. The time 

T 2 

scale to — lB ^he ^ime required for the dopants to 

travel a distance L under a constant voltage Vq. 

Let us first assume white Gaussian noise of intensity T 

(ect)) = o, mm)=m-t'), (n) 

which can be tuned experimentally by varying the tem- 
perature T of the environment. In fact, using the above 
definitions the diffusion coefficient is 
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which has to be compared with 



D = D exp 



(12) 



(13) 



where Do ~ 10 -3 cm 2 /s and E v ss 0.5eV is the activation 
energy for oxygen vacancy diffusion [5S]. We note here 
that the noise in our model was introduced in the sim- 
plest possible way such that it shakes the sharp bound- 
ary between the doped and undoped regions of the TiC>2 
memristor. Of course, in the real system the boundary 
is smeared. However, it was not our intention to present 
a detailed physical model of the TiC>2 memristor, rather 
to point out an interesting phenomenon due to noise. 

Without any noise the size of the hysteresis in the 
current-voltage characteristic depends on the applied 
voltage frequency. In particular, at low frequencies (lu <C 
27r/£o) the variation of memristance is very small (see 
Fig. [2| with a consequent small hysteresis loop (Fig. [3]) . 
The addition of a small amount of noise does not change 
this hysteresis loop considerably, but by increasing the 
noise strength we find an optimal value of T at which 
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FIG. 2: Single realization of the memristance M(w) as a func- 
tion of time (in units of the time period T = 2tt/ujo) for differ- 
ent noise strengths. The amplitude of the applied voltage is 
Vo = 5.5 mV and the angular frequency is ui — 0.25 Hz. The 
resistance ratio is R a{{ /R OTl — 4 and the initial location of the 
boundary for all simulations is taken as wq/L — 0.9. 
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FIG. 3: Current-voltage characteristic of the memristor repre- 
sented in Fig.[T]averaged over 100 realizations of the stochastic 
process and for different noise strengths. Here 7o = Vo/Ron 
is the maximum possible current through the system. The 
other parameters are the same as in Fig. [2] 



the hysteresis is considerably enhanced. In order to find 
this value we proceed as follows. For every finite value 
of the noise strength T the stochastic differential equa- 
tion [Eq. (10)] (along with the current and Eq. is 

]) and the 



solved (using the Euler-Maruyama method 
boundary position {w(t)}^ is calculated for every realiza- 
tion of the stochastic process. The power spectrum (de- 
fined as the squared absolute value of the Fourier trans- 
form of {w(t)}^) is then computed and averaged over 
multiple realizations. If the output {w(£)}{ is well syn- 
chronized with the external periodic voltage, the power 
spectrum exhibits a strong peak at the voltage frequency 
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Finally, we have also checked the effect of introducing 
colored noise into the system. We have considered noise 
with an exponentially decaying autocorrelation function 
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FIG. 4: Power spectrum averaged over 100 realizations. The 
height of the peak at cj = Wq is a measure of synchronization 
between the applied voltage and the noise. Inset: The signal- 
to-noise ratio at w = wo is plotted vs the noise strength and 
its maximum defines the stochastic resonance. 



uj (Fig. El). The signal-to- noise ratio (SNR) is then de- 
fined as the height of the peak divided by the height of 
the noise background at frequency ujq. The SNR attains 
its maximum for the noise strength at which the stochas- 
tic resonance occurs (see the inset of Fig. [2]). From our 
simulations we find that the maximum SNR is found for 
r = KrV 1 (Fig. [33]. Fig. § indeed confirms that 
for this value of noise the hysteresis loop is the widest, 
compared with the loops for other values of noise. In par- 
ticular, we find that stronger noise destroys the hysteresis 
loop as intuitively expected. 

This picture can be explained qualitatively as follows. 
When the frequency and amplitude of the external drive 
are low and the external noise introduced into the sys- 
tem is zero or very weak, the boundary movement closely 
follows the change in the applied voltage and sweeps 
a small region of the system [53]. If the noise is very 
strong, the boundary moves erratically between the edges 
of the memristor with almost no dependence on the ap- 
plied voltage. In both cases the hysteresis loop is narrow. 
Wide loops are obtained whenever the boundary sweeps 
wide regions following the changes in the voltage. For 
intermediate values of noise one can expect the noise to 
"help" the transitions of the boundary from one edge to 
the other. Whenever the boundary is moving from, say, 
the left edge toward the right one, the noise can ran- 
domly kick it to the right edge and on the way back kick 
it back to the left edge providing an almost ideal periodic 
movement (see Fig. [2]) . 



«(*)) = 0, (C(t)e(f))=rexp 



\t-t'\ 



(14) 



where r c is the correlation time. In this case, we have in- 
deed found (not reported here) enhancement of memory 
effects even at high frequencies w > ^ with t c ~ to. This 
is not too surprising since, loosely speaking, the addition 
of this type of noise is reminiscent of the addition of an 
external driving with frequencies lo < 1/t c . 



IV. CONCLUSIONS 

We conclude by noting that the above predictions can 
be tested experimentally by using memory resistors such 
as those considered in Ref. [21] or any other memory ele- 
ment [JJ . In a real experiment the frequency and the noise 
can be easily changed, the latter via, e.g., the external 
temperature. If we focus again on the model considered 
here, according to Eq. (13), the diffusion exponentially 



depends on the temperature. Therefore, if vacancy dif- 
fusion is the main mechanism of memory in T1O2 thin 
films, the opening of the hysteresis should be strongly de- 
pendent on the external temperature, at least for small 
enough frequencies. This can be checked by lowering 
the frequency of the applied voltage below the optimal 
one for a wide hysteresis loop, tuning the temperature 
and observing the change in the shape of the hysteresis. 
Since the mechanism of memory in this particular mem- 
ristive system is still under debate, with redox effects at 
the metal-Ti02 interface the other most probable cause 
[2"rJI |2"7] , the tunability of the noise strength provides a 
possible diagnostic tool to distinguish between the differ- 
ent mechanisms at play. In general, since in a real system 
noise is always present, it is highly possible that the hys- 
teresis curves found experimentally in several memory 
elements [JJ could result from the cooperative effect of 
the optimal frequency in the presence of noise. 
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Noise introduced directly in the input u would also pro- 
duce the phenomenon of stochastic memory. In the present 
work, however, we consider only the case of a noiseless 
source. 

Strictly speaking the analogy should be made with a con- 
tinuous system. For more details about the stochastic res- 
onance effect in continuous systems see Ref. |28| . 
For the sake of illustration, this model omits the diffusion 
term of the drift-diff usion equ ation 29 . 
Note that from Eqs. ( 12 1 and ( 13 1 this value would corre- 
spond to a temperature of 154 K. However, the model we 
use here is too simplistic to give an accurate determination 
of this number. 

Note that for other initial conditions wider loops could be 
obtained for zero noise. 



